Activity Recognition with Activity Reminders

ABSTRACT

An athletic performance monitoring system, for motivating a user to reach a goal level of athletic activity. The system may motivate the user by calculation a deficit between a current total level of activity and the goal level of athletic activity, and suggesting activity types that the user may carry out an order to reach the goal level, wherein the suggested activity types may be based on activities that are geographically close to the user, or sporting equipment worn by, or in possession of, the user.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.15/414,764, filed Jan. 25, 2017, which continuation of U.S. patentapplication Ser. No. 14/194,133, filed Feb. 28, 2014, now U.S. Pat. No.9,589,445, which claims the benefit of, and priority to, U.S.Provisional Patent Application No. 61/863,259 filed Aug. 7, 2013, andU.S. Provisional Patent Application No. 61/869,617 filed Aug. 23, 2013.The contents of all of the above listed applications are expresslyincorporated herein by reference in their entirety for any and allnon-limiting purposes.

BACKGROUND

Exercise and fitness have become increasingly popular and the benefitsfrom such activities are well known. Various types of technology havebeen incorporated into fitness and other athletic activities. Forexample, a wide variety of portable electronic devices are available foruse in fitness activity such as MP3 or other audio players, radios,portable televisions, DVD players, or other video playing devices,watches, GPS systems, pedometers, mobile telephones, pagers, beepers,etc. Many fitness enthusiasts or athletes use one or more of thesedevices when exercising or training to keep them entertained, provideperformance data or to keep them in contact with others, etc. Such usershave also demonstrated an interest in recording their athleticactivities and metrics associated therewith. Accordingly, varioussensors may be used to detect, store and/or transmit athleticperformance information. Oftentimes, however, athletic performanceinformation is presented in a vacuum or based on the overall athleticactivity. Exercisers may be interested in obtaining additionalinformation about their workouts, or daily activity.

Aspects of this disclosure are directed towards novel systems andmethods that address one or more of these deficiencies. Further aspectsrelate to minimizing other shortcomings in the art.

SUMMARY

The following presents a simplified summary of the present disclosure inorder to provide a basic understanding of some aspects of the invention.This summary is not an extensive overview of the invention. It is notintended to identify key or critical elements of the invention or todelineate the scope of the invention. The following summary merelypresents some concepts of the invention in a simplified form as aprelude to the more detailed description provided below.

Aspects of the systems and methods described herein relate to acomputer-implemented method of operating a device. The device mayreceive the location of a user, and additionally, calculate a deficitbetween a level of activity performed by the user and a goal level ofactivity. Using the calculated deficit, the device suggests one or moreactivity types geographically close to the user which may be carried outto reach the goal level of activity.

In another aspect, this disclosure relates to a non-transitorycomputer-readable media with computer-executable instructions that whenexecuted by a processor is configured to calculate a deficit between alevel of activity performed by a user and a goal level of activity, inaddition to determining athletic equipment available to the user. Usingthe calculated deficit, in addition to the information about theathletic equipment available to the user, the processor suggests one ormore activity types to be carried out by the user to reach the goallevel of activity.

This Summary is provided to introduce a selection of concepts in asimplified form that are further described below in the DetailedDescription. The Summary is not intended to identify key features oressential features of the claimed subject matter, nor is it intended tobe used to limit the scope of the claimed subject matter.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates an example system that may be configured to providepersonal training and/or obtain data from the physical movements of auser in accordance with example embodiments;

FIG. 2 illustrates an example computer device that may be part of or incommunication with the system of FIG. 1.

FIG. 3 shows an illustrative sensor assembly that may be worn by a userin accordance with example embodiments;

FIG. 4 shows another example sensor assembly that may be worn by a userin accordance with example embodiments;

FIG. 5 shows illustrative locations for sensory input which may includephysical sensors located on/in a user's clothing and/or be based uponidentification of relationships between two moving body parts of theuser;

FIG. 6 depicts an example display of a graphical user interfaceinforming a user of a cumulative number of activity points earned.

FIG. 7 is an example display of a graphical user interface forcommunicating activity points goal information to a user.

FIG. 8 schematically depicts an example display of a graphical userinterface for communicating suggestions for earning activity points tomeet an activity points goal.

FIG. 9 is a flowchart diagram of an activity goal motivation process.

DETAILED DESCRIPTION

Aspects of this disclosure relate to systems and methods for providingan athlete, or user, with information related to his/her daily physicalactivity. In one embodiment, this user activity information may includeinformation related to a user's cumulative daily activity, and acomparison of this cumulative daily activity to one or more dailyactivity goals. In another aspect, the activity information may includeinstructions, suggestions, or tips as to how a user may supplementhis/her daily activity in order to reach a daily activity level goal. Inother aspects, the systems and methods described herein consideractivities performed by a user/athlete on timescales other than dailyactivity, and may include hourly, weekly, monthly, or yearly activitylevels, or any other timescale of interest to a user performingactivities.

In order to monitor, analyze, and provide feedback on activities beingperformed by a user, athletic data may be recorded from one or moresensors receiving information related to one or more activities beingcarried out by the user. The athletic data may be actively or passivelysensed and/or stored in one or more non-transitory storage mediums, andused to generate an output, such as for example, calculated athleticattributes, feedback signals to provide guidance, and/or otherinformation. These, and other aspects, will be discussed in the contextof the following illustrative examples of a personal training system.

In the following description of the various embodiments, reference ismade to the accompanying drawings, which form a part hereof, and inwhich is shown by way of illustration various embodiments in whichaspects of the disclosure may be practiced. It is to be understood thatother embodiments may be utilized and structural and functionalmodifications may be made without departing from the scope and spirit ofthe present disclosure. Further, headings within this disclosure shouldnot be considered as limiting aspects of the disclosure and the exampleembodiments are not limited to the example headings.

I. Example Personal Training System

A. Illustrative Networks

Aspects of this disclosure relate to systems and methods that may beutilized across a plurality of networks. In this regard, certainembodiments may be configured to adapt to dynamic network environments.Further embodiments may be operable in differing discrete networkenvironments. FIG. 1 illustrates an example of a personal trainingsystem 100 in accordance with example embodiments. Example system 100may include one or more interconnected networks, such as theillustrative body area network (BAN) 102, local area network (LAN) 104,and wide area network (WAN) 106. As shown in FIG. 1 (and describedthroughout this disclosure), one or more networks (e.g., BAN 102, LAN104, and/or WAN 106), may overlap or otherwise be inclusive of eachother. Those skilled in the art will appreciate that the illustrativenetworks 102-106 are logical networks that may each comprise one or moredifferent communication protocols and/or network architectures and yetmay be configured to have gateways to each other or other networks. Forexample, each of BAN 102, LAN 104 and/or WAN 106 may be operativelyconnected to the same physical network architecture, such as cellularnetwork architecture 108 and/or WAN architecture 110. For example,portable electronic device 112, which may be considered a component ofboth BAN 102 and LAN 104, may comprise a network adapter or networkinterface card (NIC) configured to translate data and control signalsinto and from network messages according to one or more communicationprotocols, such as the Transmission Control Protocol (TCP), the InternetProtocol (IP), and the User Datagram Protocol (UDP) through one or moreof architectures 108 and/or 110. These protocols are well known in theart, and thus will not be discussed here in more detail.

Network architectures 108 and 110 may include one or more informationdistribution network(s), of any type(s) or topology(s), alone or incombination(s), such as for example, cable, fiber, satellite, telephone,cellular, wireless, etc. and as such, may be variously configured suchas having one or more wired or wireless communication channels(including but not limited to: WiFi®, Bluetooth®, Near-FieldCommunication (NFC) and/or ANT technologies). Thus, any device within anetwork of FIG. 1, (such as portable electronic device 112 or any otherdevice described herein) may be considered inclusive to one or more ofthe different logical networks 102-106. With the foregoing in mind,example components of an illustrative BAN and LAN (which may be coupledto WAN 106) will be described.

1. Example Local Area Network

LAN 104 may include one or more electronic devices, such as for example,computer device 114. Computer device 114, or any other component ofsystem 100, may comprise a mobile terminal, such as a telephone, musicplayer, tablet, netbook or any portable device. In other embodiments,computer device 114 may comprise a media player or recorder, desktopcomputer, server(s), a gaming console, such as for example, a Microsoft®XBOX, Sony® Playstation, and/or a Nintendo® Wii gaming consoles. Thoseskilled in the art will appreciate that these are merely example devicesfor descriptive purposes and this disclosure is not limited to anyconsole or computing device.

Those skilled in the art will appreciate that the design and structureof computer device 114 may vary depending on several factors, such asits intended purpose. One example implementation of computer device 114is provided in FIG. 2, which illustrates a block diagram of computingdevice 200. Those skilled in the art will appreciate that the disclosureof FIG. 2 may be applicable to any device disclosed herein. Device 200may include one or more processors, such as processor 202-1 and 202-2(generally referred to herein as “processors 202” or “processor 202”).Processors 202 may communicate with each other or other components viaan interconnection network or bus 204. Processor 202 may include one ormore processing cores, such as cores 206-1 and 206-2 (referred to hereinas “cores 206” or more generally as “core 206”), which may beimplemented on a single integrated circuit (IC) chip.

Cores 206 may comprise a shared cache 208 and/or a private cache (e.g.,caches 210-1 and 210-2, respectively). One or more caches 208/210 maylocally cache data stored in a system memory, such as memory 212, forfaster access by components of the processor 202. Memory 212 may be incommunication with the processors 202 via a chipset 216. Cache 208 maybe part of system memory 212 in certain embodiments. Memory 212 mayinclude, but is not limited to, random access memory (RAM), read onlymemory (ROM), and include one or more of solid-state memory, optical ormagnetic storage, and/or any other medium that can be used to storeelectronic information. Yet other embodiments may omit system memory212.

System 200 may include one or more I/O devices (e.g., I/O devices 214-1through 214-3, each generally referred to as I/O device 214). I/O datafrom one or more I/O devices 214 may be stored at one or more caches208, 210 and/or system memory 212. Each of I/O devices 214 may bepermanently or temporarily configured to be in operative communicationwith a component of system 100 using any physical or wirelesscommunication protocol.

Returning to FIG. 1, four example I/O devices (shown as elements116-122) are shown as being in communication with computer device 114.Those skilled in the art will appreciate that one or more of devices116-122 may be stand-alone devices or may be associated with anotherdevice besides computer device 114. For example, one or more I/O devicesmay be associated with or interact with a component of BAN 102 and/orWAN 106. I/O devices 116-122 may include, but are not limited toathletic data acquisition units, such as for example, sensors. One ormore I/O devices may be configured to sense, detect, and/or measure anathletic parameter from a user, such as user 124. Examples include, butare not limited to: an accelerometer, a gyroscope, alocation-determining device (e.g., GPS), light (including non-visiblelight) sensor, temperature sensor (including ambient temperature and/orbody temperature), sleep pattern sensors, heart rate monitor,image-capturing sensor, moisture sensor, force sensor, compass, angularrate sensor, and/or combinations thereof among others.

In further embodiments, I/O devices 116-122 may be used to provide anoutput (e.g., audible, visual, or tactile cue) and/or receive an input,such as a user input from athlete 124. Example uses for theseillustrative I/O devices are provided below, however, those skilled inthe art will appreciate that such discussions are merely descriptive ofsome of the many options within the scope of this disclosure. Further,reference to any data acquisition unit, I/O device, or sensor is to beinterpreted disclosing an embodiment that may have one or more I/Odevice, data acquisition unit, and/or sensor disclosed herein or knownin the art (either individually or in combination).

Information from one or more devices (across one or more networks) maybe used to provide (or be utilized in the formation of) a variety ofdifferent parameters, metrics or physiological characteristics includingbut not limited to: motion parameters, or motion data, such as speed,acceleration, distance, steps taken, direction, relative movement ofcertain body portions or objects to others, or other motion parameterswhich may be expressed as angular rates, rectilinear rates orcombinations thereof, physiological parameters, such as calories, heartrate, sweat detection, effort, oxygen consumed, oxygen kinetics, andother metrics which may fall within one or more categories, such as:pressure, impact forces, information regarding the athlete, such asheight, weight, age, demographic information and combinations thereof.

System 100 may be configured to transmit and/or receive athletic data,including the parameters, metrics, or physiological characteristicscollected within system 100 or otherwise provided to system 100. As oneexample, WAN 106 may comprise server 111. Server 111 may have one ormore components of system 200 of FIG. 2. In one embodiment, server 111comprises at least a processor and a memory, such as processor 206 andmemory 212. Server 111 may be configured to store computer-executableinstructions on a non-transitory computer-readable medium. Theinstructions may comprise athletic data, such as raw or processed datacollected within system 100. System 100 may be configured to transmitdata, such as energy expenditure points (otherwise referred to asactivity points, or as a level of activity), to a social networkingwebsite or host such a site. Server 111 may be utilized to permit one ormore users to access and/or compare athletic data. As such, server 111may be configured to transmit and/or receive notifications based uponathletic data or other information.

Returning to LAN 104, computer device 114 is shown in operativecommunication with a display device 116, an image-capturing device 118,sensor 120 and exercise device 122, which are discussed in turn belowwith reference to example embodiments. In one embodiment, display device116 may provide audio-visual cues to athlete 124 to perform a specificathletic movement. The audio-visual cues may be provided in response tocomputer-executable instruction executed on computer device 114 or anyother device, including a device of BAN 102 and/or WAN. Display device116 may be a touchscreen device or otherwise configured to receive auser-input.

In one embodiment, data may be obtained from image-capturing device 118and/or other sensors, such as sensor 120, which may be used to detect(and/or measure) athletic parameters, either alone or in combinationwith other devices, or stored information. Image-capturing device 118and/or sensor 120 may comprise a transceiver device. In one embodimentsensor 128 may comprise an infrared (IR), electromagnetic (EM) oracoustic transceiver. For example, image-capturing device 118, and/orsensor 120 may transmit waveforms into the environment, includingtowards the direction of athlete 124 and receive a “reflection” orotherwise detect alterations of those released waveforms. Those skilledin the art will readily appreciate that signals corresponding to amultitude of different data spectrums may be utilized in accordance withvarious embodiments. In this regard, devices 118 and/or 120 may detectwaveforms emitted from external sources (e.g., not system 100). Forexample, devices 118 and/or 120 may detect heat being emitted from user124 and/or the surrounding environment. Thus, image-capturing device 118and/or sensor 128 may comprise one or more thermal imaging devices. Inone embodiment, image-capturing device 118 and/or sensor 128 maycomprise an IR device configured to perform range phenomenology.

In one embodiment, exercise device 122 may be any device configurable topermit or facilitate the athlete 124 performing a physical movement,such as for example a treadmill, step machine, etc. There is norequirement that the device be stationary. In this regard, wirelesstechnologies permit portable devices to be utilized, thus a bicycle orother mobile exercising device may be utilized in accordance withcertain embodiments. Those skilled in the art will appreciate thatequipment 122 may be or comprise an interface for receiving anelectronic device containing athletic data performed remotely fromcomputer device 114. For example, a user may use a sporting device(described below in relation to BAN 102) and upon returning home or thelocation of equipment 122, download athletic data into element 122 orany other device of system 100. Any I/O device disclosed herein may beconfigured to receive activity data.

2. Body Area Network

BAN 102 may include two or more devices configured to receive, transmit,or otherwise facilitate the collection of athletic data (includingpassive devices). Exemplary devices may include one or more dataacquisition units, sensors, or devices known in the art or disclosedherein, including but not limited to I/O devices 116-122. Two or morecomponents of BAN 102 may communicate directly, yet in otherembodiments, communication may be conducted via a third device, whichmay be part of BAN 102, LAN 104, and/or WAN 106. One or more componentsof LAN 104 or WAN 106 may form part of BAN 102. In certainimplementations, whether a device, such as portable device 112, is partof BAN 102, LAN 104, and/or WAN 106, may depend on the athlete'sproximity to an access point to permit communication with mobilecellular network architecture 108 and/or WAN architecture 110. Useractivity and/or preference may also influence whether one or morecomponents are utilized as part of BAN 102. Example embodiments areprovided below.

User 124 may be associated with (e.g., possess, carry, wear, and/orinteract with) any number of devices, such as portable device 112,shoe-mounted device 126, wrist-worn device 128 and/or a sensinglocation, such as sensing location 130, which may comprise a physicaldevice or a location that is used to collect information. One or moredevices 112, 126, 128, and/or 130 may not be specially designed forfitness or athletic purposes. Indeed, aspects of this disclosure relateto utilizing data from a plurality of devices, some of which are notfitness devices, to collect, detect, and/or measure athletic data. Incertain embodiments, one or more devices of BAN 102 (or any othernetwork) may comprise a fitness or sporting device that is specificallydesigned for a particular sporting use. As used herein, the term“sporting device” includes any physical object that may be used orimplicated during a specific sport or fitness activity. Exemplarysporting devices may include, but are not limited to: golf balls,basketballs, baseballs, soccer balls, footballs, powerballs, hockeypucks, weights, bats, clubs, sticks, paddles, mats, and combinationsthereof. In further embodiments, exemplary fitness devices may includeobjects within a sporting environment where a specific sport occurs,including the environment itself, such as a goal net, hoop, backboard,portions of a field, such as a midline, outer boundary marker, base, andcombinations thereof.

In this regard, those skilled in the art will appreciate that one ormore sporting devices may also be part of (or form) a structure andvice-versa, a structure may comprise one or more sporting devices or beconfigured to interact with a sporting device. For example, a firststructure may comprise a basketball hoop and a backboard, which may beremovable and replaced with a goal post. In this regard, one or moresporting devices may comprise one or more sensors, such as one or moreof the sensors discussed above in relation to FIGS. 1-3, that mayprovide information utilized, either independently or in conjunctionwith other sensors, such as one or more sensors associated with one ormore structures. For example, a backboard may comprise a first sensorconfigured to measure a force and a direction of the force by abasketball upon the backboard and the hoop may comprise a second sensorto detect a force. Similarly, a golf club may comprise a first sensorconfigured to detect grip attributes on the shaft and a second sensorconfigured to measure impact with a golf ball.

Looking to the illustrative portable device 112, it may be amulti-purpose electronic device, that for example, includes a telephoneor digital music player, including an IPOD®, IPAD®, or iPhone®, branddevices available from Apple, Inc. of Cupertino, Calif. or Zune® orMicrosoft® Windows devices available from Microsoft of Redmond, Wash. Asknown in the art, digital media players can serve as an output device,input device, and/or storage device for a computer. Device 112 may beconfigured as an input device for receiving raw or processed datacollected from one or more devices in BAN 102, LAN 104, or WAN 106. Inone or more embodiments, portable device 112 may comprise one or morecomponents of computer device 114. For example, portable device 112 maybe include a display 116, image-capturing device 118, and/or one or moredata acquisition devices, such as any of the I/O devices 116-122discussed above, with or without additional components, so as tocomprise a mobile terminal.

a. Illustrative Apparel/Accessory Sensors

In certain embodiments, I/O devices may be formed within or otherwiseassociated with user's 124 clothing or accessories, including a watch,armband, wristband, necklace, shirt, shoe, or the like. These devicesmay be configured to monitor athletic movements of a user. It is to beunderstood that they may detect athletic movement during user's 124interactions with computer device 114 and/or operate independently ofcomputer device 114 (or any other device disclosed herein). For example,one or more devices in BAN 102 may be configured to function as anall-day activity monitor that measures activity regardless of the user'sproximity or interactions with computer device 114. It is to be furtherunderstood that the sensory system 302 shown in FIG. 3 and the deviceassembly 400 shown in FIG. 4, each of which are described in thefollowing paragraphs, are merely illustrative examples.

i. Shoe-Mounted Device

In certain embodiments, device 126 shown in FIG. 1, may comprisefootwear which may include one or more sensors, including but notlimited to those disclosed herein and/or known in the art. FIG. 3illustrates one example embodiment of a sensor system 302 providing oneor more sensor assemblies 304. Assembly 304 may comprise one or moresensors, such as for example, an accelerometer, gyroscope,location-determining components, force sensors and/or or any othersensor disclosed herein or known in the art. In the illustratedembodiment, assembly 304 incorporates a plurality of sensors, which mayinclude force-sensitive resistor (FSR) sensors 306; however, othersensor(s) may be utilized. Port 308 may be positioned within a solestructure 309 of a shoe, and is generally configured for communicationwith one or more electronic devices. Port 308 may optionally be providedto be in communication with an electronic module 310, and the solestructure 309 may optionally include a housing 311 or other structure toreceive the module 310. The sensor system 302 may also include aplurality of leads 312 connecting the FSR sensors 306 to the port 308,to enable communication with the module 310 and/or another electronicdevice through the port 308. Module 310 may be contained within a wellor cavity in a sole structure of a shoe, and the housing 311 may bepositioned within the well or cavity. In one embodiment, at least onegyroscope and at least one accelerometer are provided within a singlehousing, such as module 310 and/or housing 311. In at least a furtherembodiment, one or more sensors are provided that, when operational, areconfigured to provide directional information and angular rate data. Theport 308 and the module 310 include complementary interfaces 314, 316for connection and communication.

In certain embodiments, at least one force-sensitive resistor 306 shownin FIG. 3 may contain first and second electrodes or electrical contacts318, 320 and a force-sensitive resistive material 322 disposed betweenthe electrodes 318, 320 to electrically connect the electrodes 318, 320together. When pressure is applied to the force-sensitive material 322,the resistivity and/or conductivity of the force-sensitive material 322changes, which changes the electrical potential between the electrodes318, 320. The change in resistance can be detected by the sensor system302 to detect the force applied on the sensor 316. The force-sensitiveresistive material 322 may change its resistance under pressure in avariety of ways. For example, the force-sensitive material 322 may havean internal resistance that decreases when the material is compressed.Further embodiments may utilize “volume-based resistance” may bemeasured, which may be implemented through “smart materials.” As anotherexample, the material 322 may change the resistance by changing thedegree of surface-to-surface contact, such as between two pieces of theforce sensitive material 322 or between the force sensitive material 322and one or both electrodes 318, 320. In some circumstances, this type offorce-sensitive resistive behavior may be described as “contact-basedresistance.”

ii. Wrist-Worn Device

As shown in FIG. 4, device 400 (which may resemble or comprise sensorydevice 128 shown in FIG. 1), may be configured to be worn by user 124,such as around a wrist, arm, ankle, neck or the like. Device 400 mayinclude an input mechanism, such as a depressible input button 402configured to be used during operation of the device 400. The inputbutton 402 may be operably connected to a controller 404 and/or anyother electronic components, such as one or more of the elementsdiscussed in relation to computer device 114 shown in FIG. 1. Controller404 may be embedded or otherwise part of housing 406. Housing 406 may beformed of one or more materials, including elastomeric components andcomprise one or more displays, such as display 408. The display may beconsidered an illuminable portion of the device 400. The display 408 mayinclude a series of individual lighting elements or light members suchas LED lights 410. The lights may be formed in an array and operablyconnected to the controller 404. Device 400 may include an indicatorsystem 412, which may also be considered a portion or component of theoverall display 408. Indicator system 412 can operate and illuminate inconjunction with the display 408 (which may have pixel member 414) orcompletely separate from the display 408. The indicator system 412 mayalso include a plurality of additional lighting elements or lightmembers, which may also take the form of LED lights in an exemplaryembodiment. In certain embodiments, indicator system may provide avisual indication of goals, such as by illuminating a portion oflighting members of indicator system 412 to represent accomplishmenttowards one or more goals. Device 400 may be configured to display dataexpressed in terms of activity points currency earned by the user basedon the activity of the user, either through display 408 and/or indicatorsystem 412.

A fastening mechanism 416 can be disengaged wherein the device 400 canbe positioned around a wrist or portion of the user 124 and thefastening mechanism 416 can be subsequently placed in an engagedposition. In one embodiment, fastening mechanism 416 may comprise aninterface, including but not limited to a USB port, for operativeinteraction with computer device 114 and/or devices, such as devices 120and/or 112. In certain embodiments, fastening member may comprise one ormore magnets. In one embodiment, fastening member may be devoid ofmoving parts and rely entirely on magnetic forces.

In certain embodiments, device 400 may comprise a sensor assembly (notshown in FIG. 4). The sensor assembly may comprise a plurality ofdifferent sensors, including those disclosed herein and/or known in theart. In an example embodiment, the sensor assembly may comprise orpermit operative connection to any sensor disclosed herein or known inthe art. Device 400 and or its sensor assembly may be configured toreceive data obtained from one or more external sensors.

iii. Apparel and/or Body Location Sensing

Element 130 of FIG. 1 shows an example sensory location which may beassociated with a physical apparatus, such as a sensor, data acquisitionunit, or other device. Yet in other embodiments, it may be a specificlocation of a body portion or region that is monitored, such as via animage capturing device (e.g., image capturing device 118). In certainembodiments, element 130 may comprise a sensor, such that elements 130 aand 130 b may be sensors integrated into apparel, such as athleticclothing. Such sensors may be placed at any desired location of the bodyof user 124. Sensors 130 a/b may communicate (e.g., wirelessly) with oneor more devices (including other sensors) of BAN 102, LAN 104, and/orWAN 106. In certain embodiments, passive sensing surfaces may reflectwaveforms, such as infrared light, emitted by image-capturing device 118and/or sensor 120. In one embodiment, passive sensors located on user's124 apparel may comprise generally spherical structures made of glass orother transparent or translucent surfaces which may reflect waveforms.Different classes of apparel may be utilized in which a given class ofapparel has specific sensors configured to be located proximate to aspecific portion of the user's 124 body when properly worn. For example,golf apparel may include one or more sensors positioned on the apparelin a first configuration and yet soccer apparel may include one or moresensors positioned on apparel in a second configuration.

FIG. 5 shows illustrative locations for sensory input (see, e.g.,sensory locations 130 a-130 o). In this regard, sensors may be physicalsensors located on/in a user's clothing, yet in other embodiments,sensor locations 130 a-130 o may be based upon identification ofrelationships between two moving body parts. For example, sensorlocation 130 a may be determined by identifying motions of user 124 withan image-capturing device, such as image-capturing device 118. Thus, incertain embodiments, a sensor may not physically be located at aspecific location (such as one or more of sensor locations 130 a-1306o), but is configured to sense properties of that location, such as withimage-capturing device 118 or other sensor data gathered from otherlocations. In this regard, the overall shape or portion of a user's bodymay permit identification of certain body parts. Regardless of whetheran image-capturing device is utilized and/or a physical sensor locatedon the user 124, and/or using data from other devices, (such as sensorysystem 302), device assembly 400 and/or any other device or sensordisclosed herein or known in the art is utilized, the sensors may sensea current location of a body part and/or track movement of the bodypart. In one embodiment, sensory data relating to location 130 m may beutilized in a determination of the user's center of gravity (a.k.a,center of mass). For example, relationships between location 130 a andlocation(s) 130 f/130 l with respect to one or more of location(s) 130m-130 o may be utilized to determine if a user's center of gravity hasbeen elevated along the vertical axis (such as during a jump) or if auser is attempting to “fake” a jump by bending and flexing their knees.In one embodiment, sensor location 130 n may be located at about thesternum of user 124. Likewise, sensor location 130 o may be locatedapproximate to the naval of user 124. In certain embodiments, data fromsensor locations 130 m-130 o may be utilized (alone or in combinationwith other data) to determine the center of gravity for user 124. Infurther embodiments, relationships between multiple sensor locations,such as sensors 130 m-130 o, may be utilized in determining orientationof the user 124 and/or rotational forces, such as twisting of user's 124torso. Further, one or more locations, such as location(s), may beutilized to as a center of moment location. For example, in oneembodiment, one or more of location(s) 130 m-130 o may serve as a pointfor a center of moment location of user 124. In another embodiment, oneor more locations may serve as a center of moment of specific body partsor regions.

FIG. 6 depicts an example display of a graphical user interface (GUI)informing a user of a cumulative number of activity points, or energyexpenditure points, earned during a specified time period. As discussedin relation to FIG. 1, system 100 may execute one or more processes tocalculate activity points associated with one or more activities carriedout by a user. In one embodiment, activity points relate to caloriesburned by a user during physical activity, however any quantifiablefeature of an activity may be used by system 100 to calculate activitypoints. These features may include, among others, a total time spentperforming a given activity, a total distance traveled during anactivity, a total number of steps taken during a period of activity, orcombinations thereof. Activity points may be derived from activity datainformation received by one or more sensors associated with system 100.As discussed in relation to FIG. 1-FIG. 5, one or more sensors may belocated on, among others, a wrist-worn device 128/400, a shoe-mounteddevice 126, a body-mounted device 130 a-130 o, or a portable electronicdevice 112, or combinations thereof.

In one implementation, one or more elements of system 100 may executeone or more processes to calculate a total number of activity pointsearned by a user during a period of physical activity. For example,activity data information received from one or more sensors associatedwith a user may be communicated to server 111, wherein server 111aggregates the activity data, and calculates a number of activity pointsassociated with the activity data. In another example, one or more ofdevices 112, 114, 126, 128, or 130 a-130 o may receive sensor data, andcalculate one or more activity points from the received sensor data. Inanother implementation, a cumulative number of activity points may becalculated by a remote device in system 100, and communicated to one ormore of devices 112, 114, 126, 128, or 130 a-130 o through a network,such as BAN (102), LAN (104), or WAN (106), among others. Further, inone example, a device, such as one or devices 114, 126, 128, or 130a-130 o, may be a unitary device/apparatus, and comprise a unitary bodyconfigured to accommodate one or more processors, sensors, userinterfaces, and the like.

The calculation of energy expenditure may be performed using one or moredifferent methodologies. Certain embodiments may classify physicalmotions of a user. For example, one or more activities may beclassified. A system may process data received from one or more of thesensors described above to attempt to classify a user's activity. Forexample, a system may compare a sensor signal to one or more signal oractivity “templates” or “signatures” corresponding to selectedactivities. In certain embodiments, templates may be created byattaching sensors to a user and monitoring signals generated when theuser performs various activities. In accordance with certainembodiments, an activity may be associated with an activity templatespecific to user 124. In one such embodiment, user 124 may be assigned adefault template for a specific activity unless a specific template hasbeen assigned to that activity. Thus, user 124 may create or receive(but is not required to create or receive) an activity template that maybe more accurate than a default template because the template is morespecific to the user and/or the activity. User 124 may have the optionto create templates for one or more predefined or undefined activities.A specific or otherwise new template might be shared among the communityof users. Shared templates may be based on a variety of differentsensors. In some embodiments templates may be refined or adjusted foruse with different sensors. For example, a template that was created foruse with a shoe based sensor may be refined for use with a wrist wornsensor.

An activity template may be created from data obtained from one or moreof a plurality of different sensors. For example, a first group ofsensors (e.g. sensors 126 and 128) may be utilized in the formation orrefinement of a first activity template; however, a second group ofsensors (e.g., sensors 138 and a sensor included in portable electronicdevice 112) may be utilized in the formation or refinement of a secondactivity template. In yet further embodiments, a third group of sensors,may be utilized in the creation of the first activity template for asecond user (e.g., not user 124) than utilized for the formation of thesame activity template as user 124. Thus, in accordance with certainembodiments, there is no requirement that data from a specific sensor bereceived for either: 1) the same activity template for different users;and/or 2) different activity templates for the same user.

In one embodiment, a wrist mounted accelerometer, which may be amulti-axis accelerometer, may be attached to a user and signal templatesbased on the accelerometer output when the user runs, walks, etc. may becreated. The templates may be functions of the sensor(s) used and/or thelocations of the sensor(s). In some embodiments, a single signal (orvalue) is created by combining multiple signals (or values). Forexample, three outputs of a three axis accelerometer may be summed orotherwise combined to create one or more signals. Example embodimentsmay include comparing a signal, multiple signals or a combination ofsignals to one or more templates. In some embodiments, a best matchapproach may be implemented in which every activity is attempted to beclassified. In other embodiments, if a signal, multiple signals orcombination of signals does not sufficiently match a template, theactivity may remain unclassified. Some embodiments may utilize onlytemplates for running and walking and a best first approach is used todetermine whether the user is running or walking.

Certain embodiments may not categorize the user's activity or motions,such as into motion categories (e.g., running, walking, soccer), butrather determine energy expenditure without categorizing the data. Inone implementation, training data may be used to construct one or moremodels, otherwise referred to as experts, or expert models, forpredicting, among others, a volume of oxygen consumption based upon (atleast in part) one or more individual-specific properties such as agender, a mass and/or a height of a user. Accordingly, information fromone or more sensors associated with a device, such as device 112, 126,128, 130, and/or 400, may be used to calculate one or more attributes.In turn, the calculated attributes may be compared to attributesassociated with one or more constructed models, and thereby, used topredict a volume of oxygen being consumed by a user while outputtingmotion signals (sensor output values) corresponding to the calculatedattributes. For example, a user may be performing an activity, such asplaying soccer, while wearing a sensor device on an appendage. Thesensor device, in turn, may output sensor values, which may be processedto calculate one or more attributes. Subsequently, the one or morecalculated attributes may be compared to one or more attributesassociated with one or more models, and an estimation of a volume ofoxygen being consumed by the user while playing soccer may be made.Furthermore, said estimation of a volume of oxygen being consumed may beused to estimate energy expenditure values by the user playing soccer.

In one implementation, portable electronic device 112 may display a GUI600 communicating a total, or cumulative number of activity points 602earned by a user during a specified time period 604. In anotherimplementation, a user may interact with GUI 600 to receive informationrelated to the earned number of activity points 602, wherein thisrelated information may include one or more activity types carried out,or one or more locations at which the activities were carried out, amongothers. It will be readily apparent to one of ordinary skill thatinteraction with GUI 600 may be by any conventional means. For example,portable electronic device 112 may have a capacitive screen, and a usermay interact with GUI 600 by touching one or more portions of thecapacitive screen with one or more fingers. In other examples,interaction with GUI 600 may be via one or more control buttons.Furthermore, it will be readily apparent to those of skill that GUI 600may additionally, or alternatively, be displayed on one or more devices114, 126, 128, or 130 a-130 o, among others associated with system 100.It will further be understood that GUI 600 is an exemplary embodiment ofa graphical user interface for conveying activity point information to auser, and other alternative embodiments of GUI 600 may be employedwithout departing from the scope of the disclosure described herein.

FIG. 7 is an example display of a GUI 700 for communicating activitypoints goal information (otherwise referred to as activity level goalinformation) to the user. Accordingly, GUI 700 may be used to motivate auser to increase his/her total amount of physical activity during aspecified time period in order to reach one or more predetermined goalpoints. In one implementation, GUI 700 may be displayed on a portableelectronic device 112, however, and as described in relation to GUI 600from FIG. 6, GUI 700 may be displayed on one or more alternative, orsupplementary devices from system 100. In particular, GUI 700 includes agoal status indicator 702. In one embodiment, the goal status indicator702 is a bar chart that dynamically fills as the number of activitypoints earned by a user increases. In the exemplary embodiment of FIG.7, the goal status indicator 702 includes a current number of activitypoints indicator 706, and a goal number of activity points indicator704. However, it will be readily apparent to those of skill that thegoal status indicator 702 may be embodied using any appropriate chart,symbol, or text to represent a relationship between a current cumulativenumber of physical activity points and a goal number of physicalactivity points. GUI 700 further includes message field 710 forcommunicating one or more points of information to the user related tohis/her current cumulative activity points in relation to a goal numberof activity points. In this way, message field 710 may be used tocommunicate one or more motivational messages/reminders to the user inorder to encourage the user to continue to participate in one or morephysical activities in order to meet prescribed goal number of activitypoints. The motivational messages communicated via message field 710(otherwise referred to as reminder field 710) may include, among others,a percentage value corresponding to a ratio between a current cumulativenumber of activity points and a goal number of activity points when thepercentage value is greater than, for example, 80%. In anotherimplementation, a motivational message communicated via message field710 may include a number of minutes of physical activity that may earn anumber of activity points to reach a goal number of activity points,when the number of minutes is below a threshold, which may be, forexample, 30 minutes. Furthermore, it will be readily apparent to thoseof skill that message field 710 may communicate a wide variety ofalternative motivational messages to increase the likelihood that a userwill continue participating in one or more physical activities in orderto achieve a goal number of activity points over a predetermined timeperiod. Additionally, message field 710 may be communicated to a userseparately to other elements of GUI 700, such as goal status indicator702.

GUI 700 may include interaction field 708, wherein upon selection, by auser, of interaction field 708, the user is presented with one or moresuggestions for earning activity points to reach the goal number ofactivity points 704. These one or more suggestions are described infurther detail with reference to FIG. 8.

FIG. 8 schematically depicts an example display of a GUI 800 forcommunicating one or more suggestions for earning activity points tomeet an activity points goal. GUI 800 may, in one exemplaryimplementation, be displayed on a portable electronic device 112,however GUI 800 may alternatively be displayed on one or more devices114, 126, 128, or 130 a-130 o associated with system 100, among others.GUI 800 may include a map of local activities 802, wherein map 802 maybe generated based on location data received from a GPS sensorassociated with portable electronic device 112. Map 802 may display acurrent location 804 at the map's center, and one or more nearbylocations at which one or more activities may be performed. In theexemplary embodiment of FIG. 8, map 802 displays a tennis course that is0.3 miles from the user's current location, and a basketball court thatis 0.5 miles from the user's current location.

In one implementation, activities displayed on map 802 may be associatedwith one or more other individuals with whom the user of GUI 800 has aknown relationship. These known relationships may be established, bysystem 100, by executing one or more processes to search one or moreonline social networks associated with user. In this way, one or more“friends” of the user may share their location and current activity withthe user of GUI 800 through system 100. In another implementation, map802 may suggest one or more activities within a predetermined distanceof the user's current location based on user preferences forparticipation in one or more specific sports. In yet anotherimplementation, map 802 may suggest one or more activities based on anumber of participants, wherein the participants are unknown to theuser. In this way, map 802 may suggest one or more locations forparticipating in “pickup” games (games involving participants who areunknown to the user), among others. In another embodiment, map 802 maydisplay one or more locations associated with one or more activitiesbased on athletic equipment in possession of the user. In this way, forexample, when the user is wearing a pair of basketball sneakers, system100 may suggest basketball-related activities via GUI 800, among others.Information regarding the type of sports equipment in possession of theuser may be communicated via one or more sensors associated with system100, such as one or more shoe-mounted devices 126, as described inrelation to FIG. 1. In this way, one or more sensor-enabled pieces ofsports equipment/devices may communicate a signal to portable electronicdevice 112 indicating that the user is in possession of equipmentassociated with one or more sporting/athletic activities. Alternatively,sports equipment associated with the user may be recorded by system 100in memory, such as memory 202, and such that a database of sportsequipment associated with the user is retained, based on data input bythe user to the database, and wherein the sports equipment need not besensor enabled.

GUI 800 may further include information field 806 for suggesting one ormore activities that may be performed by the user to earn activitypoints to meet an activity points goal, wherein the activities suggestedin information field 806 may not be based on a proximity of one or moreother individuals, or a sports facility, to the current location of theuser. In this way, information field 806 may suggest one or moreactivities based on sports equipment in possession of the user.Information field 806, and map 802, may alternatively suggest one ormore activities based on one or more activities performed by the user inthe past, and recorded in memory, such as memory 202. Furthermore, itwill be readily apparent to those of skill that information field 806,and map 802, may suggest one or more activities to a user based on aplurality of data types which may include, in addition to location data,data related to a number of participants and availability of sportsfacilities, and data related to the sports equipment available to theuser, among others, suggestions based on user viewing habits, whereinGUI 800 may suggest one or more physical activities associated withsports that are watched by the user on television, or searched for bythe user on the Internet, among others.

Furthermore, information field 806, and map 802, may indicate anestimated number of activity points that may be earned based on one ormore durations of physical activity associated with the one or moreactivity-type suggestions. The one or more estimated number of activitypoints associated with one or more durations of physical activity may bebased on a deficit number of activity points associated with the user inorder to reach an activity points goal. For example, if a user requiresfifty activity points to reach a daily activity points goal, theestimated number of activity points displayed by map 802, or informationfield 806, may be associated with durations of physical activitycorresponding to approximately fifty activity points.

FIG. 9 is a flowchart diagram of an activity goal motivation process900. Process 900 may be executed in order to suggest one or morephysical activities to be performed by a user in order to earn activitypoints, or energy expenditure points, to meet a goal number of pointsfor a given time period. This time period may be, among others, anhourly, daily, weekly, monthly, or yearly activity points goal, amongothers. Furthermore, process 900 may be executed by one or more devicesassociated with system 100, as described in relation to FIG. 1. In thedisclosure that follows, process 900 will be described in relation to aportable electronic device 112, however one of ordinary skill willunderstand that process 900 may be executed by a plurality of differentdevices, such as devices 114, 126, 128, or 130 a-130 o associated withsystem 100.

Process 900, at block 902, receives location information that identifiesa current location of a user. As described in relation to FIG. 6 andFIG. 7, this location information may be received from a GPS sensorassociated with a portable electronic device 112. However, in otherimplementations, location information may be received based on an IPaddress associated with an Internet connection to portable electronicdevice 112, a radio signal associated with cellular communication toportable electronic device 112, or a user input to portable electronicdevice 112 specifying a geographic location, among others. At block 904,process 900 receives data related to a cumulative number of activitypoints earned by the user during a specified time period, wherein theearned number of activities points correspond to the total amount ofphysical activity carried out by the user. Alternatively, and at block904, process 900 may determine, or calculate one or more activity pointsearned by the user based on activity data received from one or moresensors, wherein the one or more sensors may be associated with one ormore of devices 112, 114, 126, 128, or 130 a-130 o from FIG. 1.Additionally, at block 904, process 900 may receive data related to anactivity points goal, wherein an activity points goal corresponds to atarget amount of physical activity to be performed by the user during aspecified time period. Block 904 may include a calculation of a deficitnumber of activity points corresponding to the numerical differencebetween the activity points goal and the current cumulative number ofactivity points earned by the user.

Accordingly, in one example, a number of activity points may bedetermined/calculated, based on sensor data generated as a result ofphysical motion of a user over a first time period. This determinationmay be carried out at, in one example, block 904 of process 900.Further, this number of activity of activity points may be added to acumulative number of activity points accrued by the user from a startingtime point. Additionally, the number of activity points earned/accruedover the first time period may be compared to a goal activity pointtotal, wherein the goal activity point total may be associated with asecond time period. As such, in one specific example, a starting timemay be t=0 seconds. The first time period may be 10 seconds. The secondtime period may be 30 seconds, which would span t=0 seconds to t=30seconds, and wherein the 10 second first time period is encompassedwithin the second period, e.g. from t=8 seconds to t=18 seconds, and thelike. Those of ordinary skill in the art will understand that thespecific time period durations should not limit this disclosure, andthat the first period, second period, and starting time point may be anylength of time, or any time of day, and the like.

Block 906 of process 900 identifies one or more user preferencesassociated with athletic activities. These user preferences may includeinformation related to other individuals known to the user participatingin one or more athletic activities. For example one or more individualsknown to the user may communicate their location and an athleticactivity currently being performed, such that the user has anopportunity to join into an organized game associated with a particularsport, among others. The user preferences may further includeinformation related to athletic activities performed by the user in thepast. In this way, system 100 may retain a database, in memory 212, ofsports of interest to the user. Furthermore, the user preferences may bebased on athletic equipment owned by, worn by, or in possession of theuser. In this way, system 100 may retain a database, in memory 212, ofactivities of interest to the user based on products owned/in possessionof the user.

Block 908 identifies one or more activities that may be performed by theuser to meet the activity points goal. This identification may be basedupon the calculation of an activity points deficit between the activitypoints goal and the current cumulative number of activity points earnedby the user, in addition to the established location of user, and theidentified activity preferences associated with the user. In this way,block 908 may identify one or more athletic activities that may beperformed by the user within a predetermined range/proximity of thecurrent location of user. In alternative embodiments, however, block 908may identify one or more activities that may be performed by the user inorder to reach the activity points goal, wherein the identifiedactivities are not based upon a proximity to the user's currentlocation.

In one example, block 908 may identify one or more activities that maybe performed by the user to meet an activity point goal of an activitysession. As such, block 908 may include calculating a difference(deficit) between an energy expenditure metric for a current activitysession and an energy expenditure metric for a previous activity sessionfor a same athletic activity, among others.

At block 910, system 100 may transmit data identifying activitysuggestions to the user. In one embodiment, these suggestions may becommunicated to the user via a graphical user interface, such as GUI 800from FIG. 8. The information communicated to the user may be ordered, orranked, such that, among others, physical activities known to be ofgreater interest to the user are preferentially displayed to the user.For example, process 900 may determine, based on a number of occasionsduring which the user participated in basketball games, that the userhas a preference for the sport of basketball. In response, process 900,at block 910, may preferentially display activity suggestions related tobasketball. In this way, process 900 may be more likely to motivate theuser to participate in further physical activity in order to reach thepredetermined activity points goal. In another implementation, process900 may rank activity suggestions based on estimated activity durationsto make up the user's cumulative number of activity points to theactivity points goal. As such, a motivational message to a user may rankone or more physical activities based on a likelihood that there will beenough time within an activity period to earn enough activity points toreach an activity goal for the activity period. In one example, theactivity period may be a half hour, an hour, a day, a week, or a month,or any other period of time. In one example, the ranking of the one ormore physical activities may be carried out by a processor within aunitary device, such as devices 114, 126, 128, or 130 a-130 o.Accordingly, in one example, the ranking may determine a probability(likelihood) that a given physical activity can be participated in by auser and result in a number of activity points being earned(calculated/awarded to the user etc.) to meet an activity points goal.This probability may be based on a proximity of the user to a sportingfacility to carry out one or more physical activities, an amount of timeleft in an activity period during which an activity points goal is to bemet, and a record of physical activities carried out by the user in thepast, among others. In this way, based on the record of physicalactivities carried out by the user over a previous time period, theprobability may favor (rank more highly) a first activity for which theuser consistently earns a first amount of activity points, over a secondactivity for which the user earns a second, significantly variableamount of activity points. In one specific example, the ranking may ranka first activity, for which the user consistently earns 100+/−10activity points per hour higher than a second activity for which theuser, from a record of user activity, earns 110+/−90 activity points perhour, and the like.

In addition, block 910 may communicate one or more points forinformation in order to motivate the user to continue with physicalactivity in order to meet the activity points goal. These points ofinformation may include a description of the user's current cumulativenumber of activity points in relation to the goal number of activitypoints, or one or more estimated time durations that would be sufficientto make up the deficit between the current cumulative number of activitypoints and the activity points goal, among others.

The process 900 may be implemented in an activity monitoring device.Such an activity monitoring device may be a general purpose computer ormobile device which is configured to operate as an activity monitoringdevice or may be a device designed specifically for this function.

The activity monitoring device may have a context identifying modulewhich is configured to determine or receive information regarding thelocation of the user (block 902) and/or the athletic activitypreferences of the user based on, for example, the athletic equipment inpossession of the user (block 906).

The activity monitoring device may further comprise a deficitdetermining module which calculates the deficit number of activitypoints in block 904.

An activity suggestion module may transmit data identifying activitysuggestions to the user in block 910 based on the deficit determined bythe deficit determining module and information provided by the contextidentifying module regarding the location and/or athletic activitypreferences of the user.

Context information may be derived based on the situation of the user(i.e. relating to location, preferences, equipment resources, etc.). Thecontext information can be used to suggest suitable activities for theuser to achieve their activity points goal. This is performedautomatically or semi-automatically and thus avoids the need for theuser to carry out extensive research into suitable activities. A usermay therefore be able to more quickly identify suitable activities, withminimal input directly from the user. Accordingly, data throughput andpower consumption of the associated device may be reduced. Further, asthe data input requirements are reduced, the device need not have such acomplicated input system. This may reduce the complexity, cost,reliability, durability, and/or power consumption of the device.

In any of the above aspects, the various features may be implemented inhardware, or as software modules running on one or more processors.Features of one aspect may be applied to any of the other aspects.

There may also be provided a computer program or a computer programproduct for carrying out any of the methods described herein, and acomputer readable medium having stored thereon a program for carryingout any of the methods described herein. A computer program may bestored on a computer-readable medium, or it could, for example, be inthe form of a signal such as a downloadable data signal provided from anInternet website, or it could be in any other form.

Sessions

Alternative embodiments of the invention may use alternative oradditional equations for calculating point values and/or otherquantities. The equations may include derivations of measured and/orcalculated values. Derivations that include time periods may be used toshow rates and rates of change. For example, one equation may be used todetermine a rate of accumulating activity points or energy expenditurepoints. Another equation may be used to determine a quantity of activitypoints or energy expenditure points accumulated over a predeterminedtime period.

Some equations may use variables other than time. For example, someequations may be used to calculate a value as a function of activitypoints or energy expenditure points and steps. Calculating values thatare functions of activity points or energy expenditure points and othervariables may be used to compare the efficiencies of various activities.For example, an equation may be used to determine that taking steps at afaster pace may result in activity points or energy expenditure pointsaccumulating at a faster per step pace. Another exemplary equation maydetermine activity points or energy expenditure points per apredetermined distance or a unit of distance.

Some equations may be used to calculate first and/or second derivativesof measured or calculated values to show rates and rates of change. Forexample, an equation may be used to calculate or estimate a rate ofaccumulation of activity points or energy expenditure points at a giventime. In some embodiments an instantaneous rate of accumulation ofactivity points or energy expenditure points is displayed to a user viadisplay 235 or a display that is part of a mobile device.

After the energy expenditure points are calculated, the calculatedpoints may be combined, such as being added, to a total in step 612. Thetotal may allow user 124 (and/or selected individuals or groups approvedby user 124) to see how many points are earned over various periods oftime, such as days, weeks and months. Totals may also be calculated formultiple time periods. For example, a user may receive totals forperiods that include 24 hours, one week, one month and one year. In someembodiments users may select other time periods or deselect timeperiods. A user may track multiple time periods concurrently and trackpoints award since the beginning of use of a device or start of aprogram. The total for any giving time period may represent pointsearned for several activities. For example, in a day a user may receivepoints for walking, jogging and sprinting during different time periods.As mentioned above, the points earned for each activity may be afunction of a corresponding activity factor.

As indicated above, systems and methods may be variously implemented todetermine a rate that a user accumulates activity points or energyexpenditure points. In one embodiment, energy expenditure intensityvalues may be calculated for one or more time periods. The plurality oftime periods may be within a unitary time frame, such as a minute, 5minutes, 10 minutes, an hour, or a day. Those skilled in the art willappreciate that these are merely examples. In certain embodiments, auser may designate or alter the duration and/or quantity of time periodsand/or time frame.

Certain embodiments may organize data collected at different timeperiods into a collection. As one example, data collected during timeperiods within a time frame may be designated as a “session”. Forexample, a UI may be configured to permit a user to designate pastactivity data as being associated with a specific activity, sport, eventor motion. In one embodiment, a user may indicate that past activities(which may be stored as raw and/or processed data, including forexample, energy expenditure points or values) were collected during asoccer game or running session. As another example, an input maydesignate that future activities, such as a scheduled soccer game orrunning event, is a “session” or collection of related data. One or moredesignations may be suggested or even automatically generated fromelectronic data, such as information stored in relation to a calendarapplication on an electronic device. The electronic data may be storedon the same device comprising a sensor from which at least a portion ofthe motion data is collected from and/or configured to receive data fromat least one of the sensors.

In another embodiment, motion data collected within a geographic areamay be used to associate that data with a specific sport or activity.For example, GPS data (which may be obtained from the same or differentdevice that obtains at least a portion of the motion data) may beutilized to determine that the user is or was within a geographic area.Thus, data collected within that area may be associated together as asession or other collection. In yet another embodiment, a combination ofinformation may be used to designate a collection of motion data, suchas a session. In one embodiment, motion data obtained at or within aproximity to a geographic location or area during or more time frames(e.g., data collected within 500 feet of a soccer field during the hoursof 2-4 pm on a Saturday) may be associated together, such as classifiedas a soccer session. Geographic data may be obtained from GPS,triangulation of communication signals, presence of other signals, suchas detection of a certain sensor, and/or by manual indication via a userinput.

Motion data, such as the data described above or anywhere throughoutthis disclosure, may only be classified as a session if at least aportion of the data meets a criterion. For example, if energyexpenditure intensity values for at least a portion of the activity doesnot meet a threshold, then a portion or all of the data may not beclassified within a session. Users may be able to tag the sessions asbeing within certain activity, either during or after collection of thedata.

Energy expenditure values, including energy expenditure intensityvalues, may be displayed, such as on a portable electronic device, as afunction of time. In one implementation, data of a session may bedisplayed. A first value collected during a first time period may bedisplayed as a first variation of a display characteristic based uponexceeding a first threshold and a second value (which may be collectedduring a second time period within the same session) may be displayed asa second variation of the display characteristic based upon exceedingthe second threshold. The display characteristic may relate to at leastone of: color, size, or shape, for example.

Further embodiments may organize similar collections of data, such assession data, together. For example, “soccer sessions” may be organizedsuch that a user may readily view trends from different sessions, whichmay be collected from motion data of different times and/or locations.Further, a first session may have been collected by one or more sensorsthat were not utilized to obtain motion data during another session. Oneor more sessions may be designated by markers on a map.

In one embodiment, one or more calculations of the motion data may occurin real-time, or as the data is being collected. In one embodiment,energy expenditure values may be displayed on an output of an electronicdevice. In one embodiment, an accumulation of energy expenditure valuesmay be displayed and other information, such as color variations mayindicate an intensity level, such as based upon the quantity of energyexpenditure of the user as a function of time.

One or more processes for calculating energy expenditure values,intensity values, and/or other values may be based, at least in part, onthe designation of the data. For example, if a session is designated asa yoga session, a first process may be used to calculate energyexpenditure, whereas a designation of a soccer game may result in adifferent process for calculating energy expenditure. Designations maybe based upon the user input, sensor data, location, and/or one or moreother factors. Further, the designation may result in utilizing (or notutilizing) one or more sensors. One or more collections of data may bere-designated. In certain embodiments, re-designation may result inrecalculating at least a portion of the data, such as by using differentsensor data, and/or different equations for calculating the values.

Further aspects relate to systems and methods that permit access of aplurality of users to at least a portion to other user's energyexpenditure, including for example access to session data of otherusers. For example, players in a basketball or soccer league may want tocompare their energy expenditure levels among teammates and/or one ormore opposing players. A collection of motion data (such as sessiondata) may be shared within one more groups. Groups may be implementedsuch that only a portion of session data (e.g., data collected during aspecific time, by a certain sensor, occurring at a certain area, etc.)may be shared with one or more users. Those skilled in the art willappreciate that one or more criteria may dictate sharing properties.Users may create groups, such that an invite from a specific individualor groups of individuals is required for access to certain information.A user may belong to multiple groups and as such, the same or differentportions of their activity data (or derivatives thereof) may be sharedwith different people. A group may provide rankings based upon, forexample, total time within sessions, total energy expenditure, energyexpenditure meeting specific criterion (e.g., locational criterion),intensity, distance, etc. Further, one or more members of the group mayset a group goal, such as earning a specific quantity of energyexpenditure during a time period or total time of activity meeting acertain threshold, for example. The goal may permit members to competeagainst each other to meet a goal, and/or permit at least two members tocooperatively meet one or more goals.

As discussed above, certain embodiments disclosed herein relate tocalculating an energy expenditure intensity value. As one example, thisvalue may be determined by quantifying the energy expenditure values fora user for a certain time period. For example, energy expenditure values(or derivatives thereof) a span of time may be used to determine anenergy expenditure intensity value for that span of time. Motion datamay be obtained from a plurality of different time periods within thetime frame. For example, data from a first sensor (which may be anaccelerometer, for example) may be obtained every second or multipletimes a second and data from a second sensor (such as a force sensor)may be obtained for the same, different or partially overlapping timeperiods. For example data from the second sensor may be collected at ½the rate of the first sensor. Data collected at these time points may beused to determine energy expenditure values for specific time periodswithin the time frame. The time frame is not required to be static. Forexample, the time period may be rolling consecutive duration of time.Yet, in other embodiments, the time frame may be static.

Certain embodiments may determine whether one or more energy expenditureintensity values meet a threshold during the time frame. Furtherembodiments may permit one or more users to compete which user or groupsof users obtained more energy expenditure during one or more periods. Inone embodiment, if a first user meets an intensity threshold level for aduration and a second user does not meet the intensity threshold levelfor that duration, the first user may be deemed a winner of thatduration. If both users met the threshold level, then a tie may bedeclared. In another embodiment, total energy expenditure over a largerperiod of time of time that includes the duration(s) in which both usersmet the threshold level) may be used to determine a winner. In yet otherembodiments, whichever user obtained a higher intensity level during theduration or the larger time period of time may be used to determine awinner. Certain embodiments may not utilize data from other actualusers. In certain implementations, a virtual AI user may be utilized.Further embodiments may not utilize data from other users, virtual orreal, but rather, a user's performance, such as meeting a goal and/orobtaining a virtual reward, may be based solely on whether they achievea set threshold, regardless of what other user's data indicates and/orif there is not any other user data for comparison. In this regard, thecompetitions and/or group activities described herein, may be “won” orat least competed in by a single user. For example, a user can “win theday” by obtaining a threshold quantity of hours or time frames in whichthey met a threshold intensity level. Thus, all disclosure hereinrelating to comparing a first user's data to a second user's data alsois intended to disclose comparing a first user's data to electronicallystored data that may not have been collected from actual activity dataof another user.

In one embodiment, it may be quantified how many times a user meets athreshold intensity level for a time frame (such as an hour or a day).Systems and methods may be implemented to quantify the number of times aplurality of users each meet a threshold within a set time, such aswithin with a day. Certain methods may be configured to permit users tocompete for instances of meeting a threshold level of intensity in a dayor other length of time. As one exemplary embodiment, it may bedetermined whether any of a plurality of users obtained an intensitythreshold level a set amount of time. If a user meets the thresholdlevel for any set duration, which may be measured by ensuring they havea plurality of consecutive expenditure values, then they may get creditfor a longer period of time. The quantity of threshold intensity levelsmeet for the specified durations may be quantified and one or more usersmay be ranked or otherwise compared. For example, a user may “win theday” if that user met more threshold levels than another user or above athreshold quantity. As discussed above, one or more tie-breakers may beused. Further, as discussed throughout this disclosure, certaincriterion may be used to determine whether sensor data is consideredand/or how it may be processed. Further, although an exemplary thresholdlevel was discussed, those skilled in the art will appreciate thatmultiple threshold levels may be used. In one embodiment, a higherthreshold intensity level may be weighted in ranking and/or determininga winner.

Further aspects relate to notifying a user when they have or have notmet a threshold level or levels. For example, a device may be configuredto motivate a user to conduct activity if they have not hit a thresholdlevel for a duration of time. Similarly, a notification may be providedto indicate that they are unlikely to meet a threshold level, such asfor a duration of time that includes the current time the user isintended to get the notification. A second reminder, which may be thesame or different from the first reminder, could be provided again whenless time remains. In one embodiment, the notification may be configuredto be generated on a device that comprises at least one sensor thatcreated at least a portion of the user's motion data. In one embodiment,the device may be configured to be worn on an appendage, such as forexample, on a user's arm, wrist, or leg. The device may comprise atleast one accelerometer for obtaining motion data. In furtherembodiments, the device may not only generate the notification, but alsoconfigured to provide the notification, such as through a display,audio, tactile feedback (e.g., vibrations) and combinations thereof. Inother embodiments, the notification may be generated on a first device,such as a computer or portable electronic device and transmitted to adevice having at least one of the sensors used to collect the data.

Further aspects relate to motivating users to reach an intense level ofmotion. For example, certain embodiments may determine how much time auser is engaged within a highly intense activity. As one example,certain embodiments may only quantify total intensity by quantifyingtime periods or time frames that meet at least one threshold of energyexpenditure intensity. For example, time conducted performing anactivity that provides energy expenditure intensity values less than afirst threshold may not be utilized. Other embodiments may utilize datameeting a plurality of thresholds. In one embodiment, time in which auser is accumulating at least a threshold quantity of energy expenditurepoints, which may or may not be directly or indirectly derived fromcalories, is marked as an intense period of time.

In one embodiment, time in which a user is accumulating at least athreshold quantity of energy expenditure points, which may or may not bedirectly or indirectly derived from calories, is marked as an intenseperiod of time. As one example, minutes in which a user earned (or isearning) at least 18 Nike FUEL points per minute may be totaled. If thenumber of minutes reaches a threshold amount, such as for example, 30minutes per day or week, then the user may be provided a virtual award.In accordance with one embodiment, Total intensity=moderate (18-27 NikeFUEL points per minute)+high (28+ Nike FUEL points per minute). Certainembodiments may have a challenge for the user to conduct activity thatprovides at least a threshold level of energy expenditure intensity forat least 30 minutes for one or more instances. In one embodiment, theinstances may be 3 or more instance of at least 30 minutes per week.

Furthermore, the present application extends to the subject-matterdescribed in the following numbered clauses.

Clause 1: An activity monitoring device comprising: a contextidentifying module configured to obtain information regarding a locationof a user and/or athletic equipment in possession of the user; a deficitdetermining module configured to determine a deficit between a level ofactivity performed by the user and a goal level of activity; and anactivity suggestion module configured to suggest, based upon thedetermined deficit and the information obtained by the contextidentifying module, one or more activity types to be carried out by theuser to reach the goal level of activity.

Clause 2: An activity monitoring device as described in Clause 1,wherein the activity suggestion module is further configured to rank theone or more activity types based on activity preferences of the user.

Clause 3: An activity monitoring device as described in Clause 2,wherein the activity preferences are based on a number of previousoccasions during which the user participated in one or more activities.

Clause 4: An activity monitoring device as described in Clause 2 or 3,wherein the activity preferences are based on a number of individualsknown to the user, and participating in an activity.

Clause 5: An activity monitoring device as described in any of Clauses 2to 4, wherein the activity suggestion module is further configured tocalculate an estimated time duration to reach the goal level for the oreach activity type, the activity suggestion unit ranking the activitytypes based on the calculated time durations.

Clause 6: An activity monitoring device as described in any precedingClause, wherein the activity suggestion module is configured to suggestactivity types in proximity to the location of the user.

Clause 7: An activity monitoring device as described in any precedingClause, wherein the context identifying module is configured todetermine the athletic equipment in possession of the user based on oneor more signals received from sensor-enabled athletic equipment.

Clause 8: An activity monitoring device as described in any precedingClause, wherein the context identifying module is configured todetermine the athletic equipment in possession of the user based on astored database of athletic equipment in possession of the user.

Clause 9: A computer-implemented method of operating a devicecomprising: obtaining context information regarding a location of a userand/or athletic equipment in possession of the user; determining adeficit between a level of activity performed by the user and a goallevel of activity; and based upon the determined deficit and contextinformation, suggesting one or more activity types to be carried out toreach the goal level of activity.

Clause 10: A computer-implemented method as described in Clause 9,further comprising: ranking the one or more activity types based onactivity preferences of the user.

Clause 11: A computer-implemented method as described in Clause 10,wherein the activity preferences are based on a number of previousoccasions during which the user participated in one or more activities.

Clause 12: A computer-implemented method as described in Clause 11,wherein the activity preferences are based on a number of individualsknown to the user, and participating in an activity.

Clause 13: A computer-implemented method as described in any of Clauses9 to 12, wherein the activity types are ranked based on one or moreestimated time durations to reach the goal level of activity.

Clause 14: A computer-implemented method as described in any precedingClause, wherein the the athletic equipment in possession of the user isdetermined based on one or more signals received from sensor-enabledathletic equipment.

Clause 15: A computer-implemented method as described in Clause 14,wherein the athletic equipment in possession of the user is determinedbased on a stored database of athletic equipment in possession of theuser.

Clause 16: A non-transitory computer-readable medium comprisingexecutable instructions that when executed cause a computer device tofunction as an activity monitoring device as described in any of Clauses1 to 8 or to perform the method as described in any of Clauses 9 to 15.

Further embodiments are provided below as exemplary clauses:

Clause 17: A computer-implemented method of operating a devicecomprising: receiving, at a processor included in the device, locationinformation identifying a location of a user; determining, by theprocessor, a deficit between a level of activity performed by the userand a goal level of activity; and based upon the determined deficit,suggesting one or more activity types in proximity to the user to becarried out to reach the goal level of activity.

Clause 18: The computer-implemented method of Clause 17, furthercomprising: ranking, by the processor, the one or more activity typesbased on activity preferences of the user.

Clause 19: The computer-implemented method of Clause 18, wherein theactivity preferences are based on a number of previous occasions duringwhich the user participated in one or more activities.

Clause 20: The computer-implemented method of Clause 18, wherein theactivity preferences are based on a number of individuals known to theuser, and participating in an activity.

Clause 21: The computer-implemented method of Clause 18, wherein theactivity types are ranked based on one or more estimated time durationsto reach the goal level of activity.

Clause 22: A non-transitory computer-readable medium comprisingcomputer-executable instructions that when executed by a processor isconfigured to perform at least: determining, by the processor, a deficitbetween a level of activity performed by a user and a goal level ofactivity; determining, by the processor, athletic equipment inpossession of the user; and based upon the determined deficit and theathletic equipment in possession of the user, suggesting, by theprocessor, one or more activity types to be carried out by the user toreach the goal level of activity.

Clause 23: The non-transitory computer-readable medium of Clause 22,wherein the processor determines the athletic equipment in possession ofthe user based on one or more signals received from sensor-enabledathletic equipment.

Clause 24: The non-transitory computer-readable medium of Clause 22,wherein the processor determines the athletic equipment in possession ofthe user based on a stored database of athletic equipment in possessionof the user.

Clause 25: The non-transitory computer-readable medium of Clause 22,further comprising: receiving, at the processor, location informationidentifying the location of the user, wherein the suggested activitytypes are further ranked based on proximity to the user.

What is claimed is:
 1. A unitary apparatus configured to be worn by auser, comprising: a processor; a sensor; a network adapter; a userinterface; and a non-transitory computer-readable medium comprisingcomputer-executable instructions that when executed by the processorperform at least: capturing, from the sensor while being worn on theuser, motion data generated by the sensor as a result of a motion of theuser; calculating, from the motion data, an activity point metricindicative of an amount of physical activity carried out by the user;displaying on the user interface a calculated goal status as a dynamicbar chart that compares the calculated activity point metric with a goalactivity point total for the user; identify one or more sportingfacilities that are within a proximity of a current location of theuser; communicating, using the user interface, a motivational message tothe user suggesting that the user participate in a physical activity atone of the one or more sporting facilities, wherein the physicalactivity, if participated in by the user within a remainder of a timeperiod, would cause the user to meet the goal activity point total,based on the calculated goal status.
 2. The unitary apparatus of claim1, wherein the physical activity is suggested based on one or morestored activities in which the user has previously participated.
 3. Theunitary apparatus of claim 1, wherein the physical activity is suggestedbased on one or more individuals known to the user who are participatingin the physical activity at the one or more sporting facilities.
 4. Theunitary apparatus of claim 1, wherein the physical activity is suggestedbased on one or more items of athletic equipment in possession of theuser.
 5. The unitary apparatus of claim 1, wherein the network adaptercomprises a cellular network adapter configured to connect the unitaryapparatus of a cellular network.
 6. The unitary apparatus of claim 3,wherein the one or more individuals known to the user are detected to beparticipating in the physical activity at the one or more sportingfacilities from data received from an online social network.
 7. Theunitary apparatus of claim 1, wherein the physical activity comprisesone or more physical activities that are communicated to the user with aranking order based on a likelihood of there being enough time remainingin the time period to meet the goal activity point total byparticipating in the one or more physical activities.
 8. The unitaryapparatus of claim 1, wherein the one more sporting facilities areidentified as destinations on a map.
 9. An apparatus, comprising: aprocessor; a sensor; a user interface; and a non-transitorycomputer-readable medium storing computer-readable instructions that,when executed by the processor, cause the apparatus to: capture motionand location data from the sensor; calculate an activity point metricfrom the motion data indicative of an amount of physical activityperformed by a user over a specified time period; calculate a deficitnumber of activity points as a difference between the activity pointmetric and a goal activity point total; identify one or more sportingfacilities that are within a proximity of a current location of theuser; communicate, through the user interface, a dynamic bar chartindicating the deficit number of activity points, and a motivationalmessage to the user suggesting that the user participate in a physicalactivity at the one or more sporting facilities to make up the deficitnumber of activity points.
 10. The apparatus of claim 9, wherein theapparatus is configured detect athletic equipment in possession of theuser, and wherein the one or more sporting facilities are identifiedbased, at least in part, on the detected athletic equipment.
 11. Theapparatus of claim 9, wherein the apparatus is a unitary apparatusconfigured to be worn on an appendage of the user.
 12. The apparatus ofclaim 9, wherein the activity point metric is based on a number ofcalories burned by the user.
 13. The apparatus of claim 9, wherein thenon-transitory computer-readable medium stores an electronic collectionof information of athletic equipment in possession of the user, andwherein the one or more sporting facilities are identified based on theinformation of athletic equipment.
 14. The apparatus of claim 9, whereinthe sensor comprises a location-determining sensor.
 15. The apparatus ofclaim 14, wherein the one or more sporting facilities are identified asdestinations on a digital map.
 16. A non-transitory computer-readablemedium comprising computer-executable instructions that when executed bya processor are configured to perform at least: capture sensor datagenerated by a first sensor as a result of a motion of a user; capturesensor data generated by a second sensor indicative of a location of theuser; calculate an activity point metric indicative of an amount ofactivity carried out by the user; identify one or more sportingfacilities that are within a proximity of a current location of theuser; communicate a dynamic bar chart indicating the activity pointmetric, and a motivational message to the user when the activity pointmetric is within a threshold amount of a goal activity point total,wherein the motivational message includes a suggestion that the userparticipate in a physical activity at the one or more sportingfacilities.
 17. The non-transitory computer-readable medium of claim 16,wherein the first sensor comprises an accelerometer sensor.
 18. Thenon-transitory computer-readable medium of claim 16, wherein the one ormore sporting facilities are identified as destinations on a digitalmap.
 19. The non-transitory computer-readable medium of claim 16,wherein the suggested physical activity is based on one or moreactivities previously participated in by the user, stored as anelectronic collection of information of previous activities in thenon-transitory computer-readable medium.
 20. The non-transitorycomputer-readable medium of claim 16, wherein the activity point metricis based on a total time participating in an athletic activity by theuser.